Evaluating Performance of Distributed Systems With MapReduce and Network Traffic Analysis

نویسندگان

  • Thiago Vieira
  • Paulo Soares
  • Marco Machado
  • Rodrigo Assad
  • Vinicius Garcia
چکیده

Testing, monitoring and evaluation of distributed systems at runtime is a difficult effort, due the dynamicity of the environment, the large amount of data exchanged between the nodes and the difficulty of reproduce an error for debugging. Application traffic analysis is a method to evaluate distributed systems, but the ability to analyze large amount of data is a challenge. This paper proposes and evaluates the use of MapReduce programming model to deep packet inspection the application traffic of distributed systems, evaluating the effectiveness and the processing capacity of the MapReduce programming model for deep packet inspection of a JXTA distributed storage application, in order to measure performance indicators. Keywords-Measurement of Distributed Systems; MapReduce; Network Traffic Analysis; Deep Packet Inspection.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Communication-Aware Traffic Stream Optimization for Virtual Machine Placement in Cloud Datacenters with VL2 Topology

By pervasiveness of cloud computing, a colossal amount of applications from gigantic organizations increasingly tend to rely on cloud services. These demands caused a great number of applications in form of couple of virtual machines (VMs) requests to be executed on data centers’ servers. Some of applications are as big as not possible to be processed upon a single VM. Also, there exists severa...

متن کامل

Evaluating Subunits Importance in Performance Measurement of Network Systems in Data Envelopment Analysis

In conventional DEA models, decision making units (DMUs) are generally assumed as a black-box while the performance of decision making sub-units (DMSUs) and their importance play crucial roles in  analyzing the performance of systems which have internal processes. The present paper introduces an ideal network which have efficient processes and next purposes a new approach for evaluating importa...

متن کامل

Adaptive Dynamic Data Placement Algorithm for Hadoop in Heterogeneous Environments

Hadoop MapReduce framework is an important distributed processing model for large-scale data intensive applications. The current Hadoop and the existing Hadoop distributed file system’s rack-aware data placement strategy in MapReduce in the homogeneous Hadoop cluster assume that each node in a cluster has the same computing capacity and a same workload is assigned to each node. Default Hadoop d...

متن کامل

Performance Guarantees for Distributed Reachability Queries

In the real world a graph is often fragmented and distributed across different sites. This highlights the need for evaluating queries on distributed graphs. This paper proposes distributed evaluation algorithms for three classes of queries: reachability for determining whether one node can reach another, bounded reachability for deciding whether there exists a path of a bounded length between a...

متن کامل

Balancing the Load to Reduce Network Traffic in Private Cloud

Infrastructure-As-A-Service (IAAS) provides an environmental setup under anyone type of cloud. In Distributed file system (DFS), nodes simultaneously serve computing and storage functions; that is parallel Data processing and storage in cloud. Here, file is considered as a data. That file is partitioned into a number of chunks allocated in distinct nodes so that MapReduce tasks can be performed...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012